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ON  THE  DUALITY  BETWEEN  ALLOCATION  AND  VALUATION 

by 
Duncan  MacRae 


1 .   INTRODUCTION 

There  is  an  intimate  relation  between  linear  control  and  linear  programming. 
Any  problem  which  can  be  formulated  as  a  discrete-time  linear  control  problem 
with  a  finite  horizon  also  can  be  formulated  as  a  multi-stage  linear  programming 
problem  and  vice-versa.   The  duality  theory  of  linear  programming  can  be  ex- 
tended to  linear  control  problems  [6].   Corresponding  to  the  primal  control 
problem,  or  maximization  problem,  is  a  dual  control  problem,  or  minimization 
problem.   The  primal  system  moves  forward  in  time;  the  dual  system  moves  back- 
ward in  time.   The  dual  of  the  dual  control  problem  is  the  primal  control 
problem.   Moreover,  the  primal  and  dual  control  problems  can  be  decomposed 
into  a  sequence  of  primal  and  dual  Hamiltonian  programming  problems.   The 
purpose  of  this  paper  is  to  provide  an  economic  interpretation  of  the  duality 

theory  for  discrete-time  linear  control  problems  and  to  apply  the  theory  to  an 
analysis  of  dual  stability  in  the  dynamic  input-output  system. 

This  research  was  supported  in  part  by  funds  from  the  General  Motors 
Corporation  under  the  General  Motors  Grant  for  Highway  Transportation  Research. 
I  am  indebted  to  E.  S.  Chase,  A.  R.  Dobell,  R.  Dorfman,  and  C.  Hamilton  for 
valuable  comments. 
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2.   ALLOCATION 

The  problem  of  allocating  goods  over  time  can  be  formulated  as  a  primal  linear 
control  problem  with  the  aid  of  linear  activity  analysis  [2,5].   The  flow  of 
commodities  in  period  k,  y(k),  is  assumed  to  be  a  linear  function  of  the  activity 
levels  in  period  k,  u(k) : 

y(k)  =  C(k)u(k),  (1) 

where  C(k)  is  a  given  matrix  describing  the  technology  of  the  system.  The 
stocks  of  commodities  at  the  beginning  of  the  period,  x(k) ,  are  the  primal 
state  variables;  and  the  activity  levels  are  the  primal  control  variables. 

The  long-run  allocation  problem  is  to  choose  the  activity  levels  over 
time,  s^  -  0  and  u(k)  -  0  for  k  =»  0,  1,...,N-1,  so  as  to  maximize  net  present 


value. 


N-1 
J  =  fgSQ  +  I      [a'(k)x(k)  +  b'(k)u(k)]  +  f^x(N),  (2) 

k=0 


subject  to  the  initial  and  terminal  conditions  on  the  stocks  of  commodities, 

GqSq  +  x(0)  =  hQ  (3) 

and  Gj^x(N)  <   h^,  (4) 

the  capacity  constraints, 

D(k)u(k)  ^  F(k)x(k)  +  d(k)   k  »  0,1,..., N-1,  (5) 
where  x(k)  is  taken  as  given,  and  the  transformation  of  stocks, 

Ax(k)  -  A(k)x(k)  +  B(k)u(k)  +  c(k+l)   k  =  0,1,..., N-1,  (6) 


3. 


where  f„,  f.,,  a(k),  b(k),  c(k+l),  d(k),  h-,  and  h^,  are  given  vectors,  A(k) , 
B(k),  D(k),  F(k),  G-,  and  G  are  given  matrices,  Ax(k)  =  x(k+l)  -  x(k),  0  is 
the  given  primal  initial  time,  and  N  is  the  given  primal  terminal  time. 

Note  that  (5)  is  not  a  constraint  on  x(k) ,  since  the  stock  of  commodities 
is  taken  as  given  in  (5) .   This  is  a  feature  distinguishing  linear  control  from 
linear  programming.   The  only  explicit  constraints  on  stocks  are  in  periods 
0  and  N  as  described  by  (3)  and  (4).  We  can  allow,  however,  for  constraints 
on  x(k)  in  all  other  periods  by  transforming  the  constraints  on  x(k)  through 
(6)  into  constraints  on  u(k-l)  of  the  form  (5). 

Associated  with  the  long-run  allocation  problem  is  a  sequence  of  short- 
run  allocation  problems,  or  primal  Hamiltonian  programming  problems.   The 
short-run  allocation  problem  in  period  k  is  to  choose  the  activity  levels, 
u(k)  ^  0,  so  as  to  maximize  net  income  in  terms  of  revenue, 

^(k)  -  a'(k)x(k)  +  b'(k)u(k) 
+  4"(k+l)[A(k)x(k)  +  B(k)u(k)  +  c(k+l)],  (7) 

subject  to  the  capacity  constraints,  (5),  in  period  k,  given  x(k)  and  the  im- 
puted prices  of  the  stocks  of  commodities  at  the  beginning  of  period  k+1, 
T(k+1). 

3.   VALUATION 

Corresponding  to  the  long-run  allocation  problem  is  a  valuation  problem,  or 
dual  linear  control  problem.   The  imputed  prices  of  the  stocks  of  commodities 
at  the  beginning  of  the  period,  *f(k),  are  the  dual  state  variables,  and  the 
imputed  prices  of  capacity  in  the  period,  X(k),  are  the  dual  control  variables. 
The  long-run  valuation  problem  is  to  choose  the  capacity  prices  over  time. 
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Y  -  0  and  X(k)  -  0  for  k  =  N-l,N-2, . . . ,0,  so  as  to  minimize  the  imputed  cost 

of  commodities  and  capacities, 

0 
*  -  Hj^Yn  +   ^   [c'Ck+DTCk+D  +  d'(k)A(k)]  +  nQH-CO),  (8) 

k"»N-l 


subject  to  the  initial  and  terminal  constraints  on  commodity  prices, 

Gj^Yj^  +  nN)  =  f^  (9) 

and  GqTCO)  >  fg.  (10) 


the  no  uniraputed  revenue  constraints, 

D'(k)X(k)  >  B'(k)4'(k+1)  +  b(k)   k  -  N-l,N-2,...,0,  (11) 

where  ^(k+l)  is  taken  as  given,  and  the  transformation  of  prices, 

AT(k+l)  -  A'(k)T(k+l)  +  F'(k)X(k)  +  a(k)   k  =  N-l,N-2, . . . ,0,        (12) 

where  A4'(k+1)  «  ^(k)  -  '{'(k+l)  ,  N  is  the  dual  initial  time,  and  0  is  the  dual 
terminal  time. 

Associated  with  the  long-run  valuation  problem  is  a  sequence  of  short- 
run  valuation  problems,  or  dual  Hamiltonian  programming  problems.   The  short- 
run  valuation  problem  in  period  k  is  to  choose  the  capacity  prices,  X(k)  -  0, 
so  as  to  minimize  net  Income  in  terms  of  imputed  cost. 


X' 


(k)  -  c'(k+l)4'(k+l)  +  d'(k)A(k) 


+  x'(k)[A'(k)H'(k+l)  +  F'(k)X(k)  +  a(k)],  (13) 

subject  to  the  no  unimputed  revenue  constraints,  (11),  in  period  k,  given 
4'(k+l)  and  x(k). 


4.   DUALITY 


The  radical  property  of  duality  between  the  long-run  allocation  problem  and  the 

long-run  valuation  problem  is  that  the  allocation  system  moves  forward  in 

2 
time  while  the  valuation  system  moves  backward  in  time.    The  stocks  evolve 

forward  as  the  imputed  prices  evolve  backward. 

The  sensitivity  analysis  [6]  demonstrates  that  along  an  optimal  path 

the  imputed  price  of  a  stock  of  commodities  measures  the  effect  on  net  present 

value  of  a  change  in  the  stock  and  the  stock  measures  the  effect  on  the  imputed 

cost  of  commodities  and  capacities  of  a  change  in  the  price.   If  the  sequences 

{x(k),  G(k);  Sq}  and  CfCk+l),  A(k);  y^}   are  optimal, 

V^^^jj{x(k)}  =   (k)   k=0,l,.-.,N,  (14) 

and  V^  .<l>{4'(k)}  =■  x(k)   k  =  N,N-1,...,0,  (15) 

where  V    .j{x(k)}  is  the  gradient  of  J  with  respect  to  x(k)  evaluated  on 

X  ^  iC^ 

{x(k),  u(k);  s_}  if  the  gradient  exists. 

The  dual  maximum  principle  [6]  shows  how  the  long-run  allocation  and 
valuation  problems  can  be  decomposed  into  a  sequence  of  short-run  allocation 

/\  j^  y\  -^ 

and  valuation  problems.   A  feasible  solution  {x(k) ,  u(k)  ;  s„}  ({'i'(k+l), 
X(k);  Yx]})  to  the  long-run  allocation  (valuation)  problem  is  an  optimal 
solution  if  and  only  if  there  exists  a  feasible  solution  {4'(k+l),  X(k);  y   } 
(ix(k),  u(k);  s„))  to  the  long-run  valuation  (allocation)  problem  with 

;y  [G(k);  x(k),  T(k+1)]  =  y[A(k);  ?(k+l),  x(k)]  (16) 

and  satisfying  the  primal  and  dual  transversality  conditions, 


2 
The  fundamental  properties  of  duality  for  linear  programming  [3]  are 

also  valid  for  linear  control. 
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V0  =  °  (17) 

and                          9j|,s^  =  0,  (18) 

where             Ax(k)  =  ^4/(k+i)7/l"(l^)  5  ^(k),  >?(k+l)],  _           (19) 

Ah^i+l)   "  ^^^y,^7([X(k)',   h^+1),   x(k)],  (20) 

Yq  =  Gq¥(0)  -  fp,  and  3j^  =  hj^  -  Gj^x(N).  (21) 

The  solutions  to  the  long-run  problems,  which  are  duals,  also  provide  the 
solutions  to  the  short-run  problems,  which  are  duals. 

This  does  not  mean,  however,  that  the  solution  to  a  long-run  problem 
can  be  generated  immediately  by  solving  a  sequence  of  short-run  problems.   For 
example,  to  make  the  allocation  decision  today  by  solving  the  short-run 
allocation  problem  requires  a  knowledge  of  future  optimal  allocation  decisions 
expressed  in  terms  of  the  imputed  price  of  the  stock  of  commodities  tomorrow, 
4'(k+l).   Moreover,  the  solution  to  the  short-run  problem  may  not  be  unique. 
In  fact,  the  primal  Hamiltonian  may  even  be  identically  equal  to  zero, 

allowing  for  an  interior  solution  to  the  problem.   In  this  way  the  dual 

3 
maximum  principle  is  quite  similar  to  the  decomposition  principle. 

The  Hamilton-Jacobi  inequality  [6],  then,  describes  the  way  the  allocation 
sequence  moves  forward  in  time  describing  the  impact  of  pricing  decisions 
tomorrow  on  imputed  cost  today  and  the  valuation  sequence  moves  backward  in 
time  describing  the  impact  of  allocation  decisions  today  on  revenue  tomorrow. 
If  {x(k),  u(k);  s  }  and  {H'(k+1),  A(k);  y  }   are  optimal  solutions  to  the  long- 
run  allocation  and  valuation  problems. 


3 
The  maximum  principle  for  linear  systems  may  even  be  considered  to  be 

a  consequence  of  the  decomposition  principle  of  linear  programming  [1]. 


Jj^{x(k)}  -  Jj^^j^{x(k)}  >  ?/[uik);   x(k),  $(k+l)] 


=  /f[X(k);  ^(k+l),  x(k)]  ^  ^^^^^^{^(k+l)}  -  <fj^{y(k+l)}, 


(22) 


where  J  {x(k)}  is  the  optimal  value  of  J  at  the  beginning  of  period  k  with 
initial  primal  state  x(k),  etc.,  and  "J)   {TCk+l)}  is  the  optimal  value  of  * 
at  the  end  of  period  k  with  an  initial  dual  state  'l'(k+l),  etc. 


5.   DYNAMIC  INPUT-OUTPUT 

As  an  example,  let  us  analyze  the  dynamic  Leontief  system  [7,8]  with  the  theory 
we  have  developed.   The  technology  of  the  system  is  described  by 


I  -  A*  +  B* 
-B* 


v(k)  > 


x(k+l) 
-x(k) 


(23) 


where  A*  is  the  input-output  matrix,  B*  is  the  stock-flow  matrix,  v(k)  is 
the  vector  of  activity  levels,  and  x(k)  is  the  vector  of  commodity  stocks  at 
the  beginning  of  period  k.   The  problem  is  to  choose  v(k)  -  0  for  k  =  0,1,..., N-1 
so  as  to  maximize  the  terminal  value  of  the  stock  of  commodities,  p'x(N),  subject 
to  (23), 


x(0)  =  Xq, 


x(k)  >  0   k  =  1,2 N-1, 


(24) 
(25) 


and 


x(N)  i  0, 


(26) 


where  p  and  x„  are  given. 

If  we  introduce  a  stock  disposal  activity,  w(k)  ^  0,  then  we  can  rewrite 
(23)  as 
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x(k+l)  =  [I  -  A*  +  B*]v(k)  -  w(k) 


(27) 


and 


B*v(k)  ^  x(k). 


(28) 


The  stock  constraint  (25),  then,  becomes 


-  [I  -  A*  +  B*]v(k)  +  w(k)  ^0   k  =  0,1 N-1. 


(29) 


The  long-run  allocation  problem,  therefore,  is  to  choose  the  activity 
levels  over  time,  v(k)  -  0  and  w(k)  -  0  for  k  =»  0,1,..., N-1,  so  as  to  maximize 
terminal  value. 


J  =  p'x(N) 


(30) 


subject  to  the  initial  and  terminal  conditions  on  the  stocks  of  commodities, 


x(0)  =  X 


and 


0 


x(N)  <  0, 


(31) 
(32) 


the  capacity  constraints. 


B*  ,  0 
-C*  "  I 


v(k) 
w(k) 


n 


_"] 


x(k)   k  =  0,1 N-1,    (33) 


where  C*  =  I  -  A*  +  B*  and  x(k)  is  given,  and  the  transformation  of  stocks. 


Ax(k)  «=  -x(k)  +  [C*.  -I] 


v(k) 
w(k) 


k  =  0,1,. ...N-l. 


(34) 


The  long-run  valuation  problem  is  to  choose  the  capacity  prices, 
y     ^   0,  <(k)  ^  0,  and  y(k)  t   0  for  k  =  N-l,N-2, . . .  ,0,  so  as  to  minimize  the 
Imputed  cost  of  the  initial  stocks  of  commodities. 


*  =  Xq4'(0), 


(35) 
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subject  to  the  initial  constraints  on  commodity  prices. 


y^  +  ^m   =  p. 


the  no  unlmputed  value  constraints. 


(36) 


B*'  I  -C*' 
0  r  I 


K(k) 
li(k) 


r  " 
c*' 

-I 


H-dc+l)    k  =  N-l,N-2,...,0, 


(37) 


where  'i'(k+l)  is  taken  as  given,  and  the  transformation  of  prices, 


AT(k+l)  -  -  4'(k+l)  +  [I,  0] 


K(k) 

y(k) 


k  =  N-l,N-2,...,0. 


(38) 


The  short-run  allocation  problem  is  to  choose  v(k)  -  0  and  w(k)  -  0 
so  as  to  maximize  net  income  in  terms  of  value. 


jt/(k)   =  4"(k+l)  (-x(k)  +  [C*,-I] 


v(k) 
w(k) 


(39) 


subject  to  the  capacity  constraints,  (33),  given  x(k)  and  ^(k+l). 

The  short-run  valuation  problem  is  to  choose  <(k)  -  0  and  M(k)  -  0  so 
as  to  minimize  net  income  in  terms  of  cost, 


^(k)  =  x'(k)  [  -^(k+l)  +  [1,0] 


K(k) 
P(k) 


(AO) 


subject  to  the  no  unimputed  revenue  constraints,  (37),  given  ^(k+l)  and  x(k). 

Along  an  optimum  path  the  imputed  value  of  the  stock  of  commodities, 
4'(k)'x(k),  is  constant,  since  J  =  $  and  If  ^  n    >  and  equal  to  the  terminal  value, 
p'x(N),  from  the  transversality  condition.   Moreover,  'i'(k)  is  not  negative 
for  all  k. 
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6.   DUAL  STABILITY 

The  radical  property  of  duality  between  allocation  and  valuation  over  time 
has  significance  for  the  relative  stability  of  the  dynamic  input-output 
system  and  its  dual.   To  see  this  we  must  examine  the  meaning  of  stability 
in  an  optimizing  model. 

First,  an  optimum  path  per  se  is  neither  stable  nor  unstable.   It  is 
characterized  by  a  number  of  conditions,  some  given  and  some  derived,  that 
make  it  determinate.   To  talk  about  stability  we  must  relax  one  of  these 
conditions.   For  example,  we  can  assume  the  initial  stock  of  commodities 
is  no  longer  given  and  examine  the  effect  of  perturbing  the  initial  stock. 
Or  we  can  drop  one  of  the  conditions  of  optimality,  such  as  the  transversality 
condition,  and  see  what  is  the  effect  of  perturbing  price  or  quantity. 
The  meaning  of  stability  will  depend  upon  which  course  we  decide  to  take. 

Second,  the  problem  we  have  analyzed  has  a  finite  horizon  and  terminal 
valuation.   Under  appropriate  assumptions  on  the  technology  a  strong  turnpike 
theorem  can  be  proved,  however,  for  both  the  dynamic  input-output  system 
and  its  dual  [8] . 

Third,  the  radical  property  of  duality  leads  to  opposite  time  arrows  in 
the  long-run  allocation  and  valuation  systems.   If  we  consider  both  systems 
together,  there  is  a  question  of  which  time  arrow  to  use. 

This  leads  us  to  a  discussion  of  the  behavior  of  the  dynamic  input- 
output  system  and  its  dual  about  the  turnpike.   There  are  a  number  of  ways 
we  can  describe  the  behavior  of  the  system  away  from  the  turnpike. 

One  approach  is  to  employ  the  dual  maximum  principle  to  derive  u(k)  = 
[v(k),  w(k)]  and  A(k)  =  [K(k) ,  y(k)]  as  a  function  of  x(k)  and  ^(k+l)  and 
then  substitute  these  relations  into  the  transformation  of  stocks  and  prices 


11. 


equations.  Ignoring  the  transversality  condition.   The  solution  to  the  short- 
run  problems,  however,  may  not  be  unique.   Moreover,  the  question  of  which 
time  arrow  to  use  is  still  with  us.   Nevertheless,  we  could  examine  the 
effect  of  perturbing  x(0)  or  4'(N).   We  would  observe  the  "saddlepoint"  behavior 
associated  with  the  turnpike. 

Another  approach  is  to  use  the  closed-loop  feedback  rules  which  are 
optimal  along  the  turnpike  to  describe  behavior  off  of  the  turnpike.   If 
B*  is  non-singular  and  A*  is  indecomposable,  the  rules  are: 

v(k)  =  [B*]"-'-x(k)  (41) 

and        K:(k)  »  [B*]"-'-C*'4'(k+l) ,  (42) 

with  w(k)  "  ij(k)  -  0  (43) 

Substituting  (41)  -  (43)  into  (34)  and  (38)  we  obtain 

Ax(k)  =  D*x(k)  (44) 

and  A4"(k+1)  =  f'(k+l)D*,  (45) 

where  D*  =  [B*]~''"C*.  (46) 

We  have  then  a  radical  dual  stability  theorem:   for  systems  of  order 
greater  than  one,  the  allocation  system  is  globally  relatively  stable  if  and 
only  if  the  valuation  system  Is  also  globally  relatively  stable.   The  proof 
follows  immediately  from  Jorgenson's  dual  stability  theorem  [4]  and  the 
radical  property  of  duality. 
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7.   CONCLUSION 

The  radical  property  of  duality  between  allocation  and  valuation  over  time 
is  that  the  allocation  system  moves  forward  in  time  while  the  valuation 
system  moves  backward  in  time.   This  property  has  a  natural  economic  inter- 
pretation and  leads  to  a  decomposition  of  the  long-run  allocation  and  valuation 
problems  into  a  sequence  of  short-run  allocation  and  valuation  problems. 
Moreover,  in  the  case  of  the  dynamic  input-output  system  it  yields  a  radical 
dual  stability  theorem,  which  inverts  the  established  theorem. 
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